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Abstract. We discuss the use of Dirac structures to obtain a better under- 
standing of the geometry of a class of optimal control problems and their 
reduction by symmetries. In particular we will show how to extend the reduc- 
tion of Dirac structures recently proposed by Yoshimura and Marsden [Yo09] 
to describe the reduction of a class of optimal control problems with a Lie 
group of symmetry. We will prove that, as in the case of reduction of implicit 
Hamiltonian or Lagrangian systems, the reduction of the variational principle 
and the reduction of the Dirac structure describing the Pontryagin Maximum 
Principle first order differential conditions coincide. Moreover they will also 
reproduce E. Martinez Lie algebroids reduction approach IMr04l to optimal 
control systems with symmetry. The geodesic subriemannian problem consid- 
ered as an optimal control problem on the Lleisenberg group, will be discussed 
as a simple example illustrating these results. 
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1. Introduction 

We will discuss in what follows the reduction of a class of optimal control prob- 
lems with symmetry by using the geometry of Dirac structures. The class of optimal 
control problems that are suitable to be discussed from this perspective are those 
that have a nice geometrical description, i.e., such that both the state and con- 
trol spaces are smooth manifolds (that will be assumed throughout all this paper 
without boundary). Moreover the controlled dynamics is given by a vector field de- 
pending on the control parameters and the objective functional is defined by means 
of a local density. There is a nice geometrical setting to describe such systems that 
allows for the introduction of auxiliary geometrical structures that clarify and help 
with the search and analysis of their solutions. This is the case for instance of the 
presence of symmetries. 

Consider an optimal control problem such that there is a Lie group acting on the 
system and such that it preserves both the dynamics and the objective functional. 
We will say then that the Lie group is a group of symmetries of the optimal control 
problem and that the optimal control problem has the given Lie group as a group 
of symmetries. The presence of a symmetry group is always a important tool 
to solve the problem. The standard way to proceed in the search for solutions of 
Hamiltonian or Lagrangian systems is to use the constants of the motion to simplify 
the problem and eventually to solve it. More generally, various reduction techniques 
permit to convert the problem at hand into a reduced one on a (family of) smaller 
spaces that sometimes are much simpler to deal with. From the solutions of the 
reduced problems a reconstruction procedure allows to obtain the solutions to the 
original problem. 

The history of reduction techniques for dynamical systems with symmetry is 
involved enough to be accurately described here. Let us just mention the recent 
contributions by Yoshimura and Marsden to the problem of reduction of variational 
principles of (possibly implicit) Lagrangian and Hamiltonian systems on tangent or 
cotangent bundles by using Dirac structures and their reductions with respect to the 
action of a Lie group. We can follow the development of these ideas starting with 
the use of Dirac structures on Lagrangian mechanics |Yo06a| , |Yo06b| , the reduction 
of the canonical Dirac structure on the cotangent bundle of a Lie group |Yo07a| , the 
first analysis of Dirac structures for implicit Lagrangian and Hamiltonian systems 
|Yo07b| and finally the Dirac reduction of cotangent bundles |Yo09| that has been 
the main inspiration of this paper. 

Pontryaguine Maximum Principle (PMP) for regular geometrical optimal control 
problems (to be precise the differential first order conditions of PMP) admits a 
presymplectic formulation that has been systematically developed in a number of 
papers (see for instance the recent contribution by Barbero et al |Ba07| - [Ba08| and 
references therein) , hence PMP can be discussed from the point of view of Dirac 
structures by using the canonical Dirac structure defined by the presymplectic 
form of the system. As it was stated before, the problem we are facing consists 
in exploiting the symmetries of the problem to simplify it. One way to do that is 
to "reduce" the system getting rid of the "redundant" degrees of freedom of the 
problem. This could be done in various ways. The first and most obvious one 
will be to reduce the presymplectic system {M, fl, H) by (pre)symplcctic reduction. 
However we need a deeper analysis of the problem of reduction. (Pre)symplectic 
reduction is obtained by selecting sub manifolds on M and quotienting them out 
with respect to the residual symmetry on them. In this way we obtain a reduced 
system with fewer degrees of freedom whose solutions allow us to reconstruct the 
actual solutions of the original system. However when we pass to the reduced system 
the variational structure of the problem, i.e. the objective functional in our case, is 
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lost, and we cannot be sure that the solutions we obtain in this way are really the 
minimum of the original objective functional. For this reason it would be better to 
have a reduction procedure, that will allow us to recover both a nice geometrical 
structure on the reduced system, as well as a reduced variational structure that 
would allow us to test the properties of the extremals we are computing. 

The notion of Dirac structures and their reductions is particularly useful in this 
sense because as it has been mentioned before, it has been shown by Marsden and 
Yoshimura that they provide the right geometrical structure that allows to recover 
the reduced variational principle. Hence describing the geometry of optimal control 
problems by using the notion of Dirac structure is useful in this sense because this 
framework allows us to reduce optimal control problems with symmetry preserving 
the variational structure. Consequently in this paper we will take the road started 
in fYo09j and we will apply the same principles to deal with geometrical optimal 
control problems with symmetry. We will show that the geometrical picture of 
the PMP implies to consider a bundle over the state space P of the system that 
will be called the Pontryaguine bundle and that plays the same role that the space 
TQ ®T*Q for an implicit Lagrangian system over the configuration space Q. We 
will describe the PMP first order differential conditions as the dynamics defined 
on the Pontryagin bundle by a Hamiltonian and a canonical Dirac structure and 
we will consider the problem of their reduction with respect to the action of a 
symmetry group G. We will obtain the equations describing the reduced PMP in 
two different ways. On one side we will derive them from the direct reduction of the 
variational principle determined by the use of a Lagrange multipliers theorem and, 
on the other side, we will proceed directly by considering the reduction of the Dirac 
structure determining the PMP on the Pontryagin's bundle. The two reductions, 
which are computed independently, will lead to the same equations, that can be 
properly called the reduced PMP. The diagramme[l] below reflects the various ideas 
involved in this paper. 

Section 2 will be devoted to establish basic notations and terminology as well 
as the discussion of the geometrical structures involved in the description of the 
mentioned class of optimal control problems. The notion of a symmetry group 
for such systems will be also made precise here and the first discussion on the 
role of Dirac structures in relation with such systems will be also introduced here. 
Section 3 will deal with the computation of the reduced Pontryagin bundle, the 
reduced variational principle and the corresponding critical points. The equations 
describing such critical points will be called the reduced PMP. Section 4 will address 
the reduction problem from the Dirac structure perspective, thus the definition of 
the reduced Dirac structure on the Pontryagin bundle will be discussed and its 
relation with the cotangent bundle reduction of the canonical Dirac structure on 
T*P, the space of states and costates of the control problem. Taking advantage 
of such relation we will be able to show quite straightforwardly the corresponding 
reduced equations that will reproduce the reduced PMP above. Finally, section 
4 will illustrate the previous ideas by the explicit computation of the solutions 
of the geodesic subriemannian problem determined by the Heisenberg group 
considered as an optimal control problem on the Heisenberg group with symmetry. 
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Dirac structures and reduction of optimal control problems with symmetry 
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Reduced cotangent bundle Dirac structure 
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Figure 1 . Reduction of Dirac structures for optimal control problems 
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2. Geometrical and Variational aspects of a class of optimal 
control problems with symmetry 

As it was indicated in the introduction we will consider in what follows geo- 
metrical optimal control problems. This implies that we are going to make some 
assumptions about the structure of the systems in order to make transparent the 
geometrical ideas involved. As it was already indicated all spaces will be assumed 
to be smooth manifolds without boundary as well as all functions, curves, vector 
fields and forms will be assumed to be smooth. In addition we will not address the 
discussion of abnormal extremals and singular optimal control systems, i.e., we will 
only consider regular optimal control problems (see below). Moreover we consider 
that the class of admissible controls consists of smooth functions. In doing so we 
will exhibit clearly the geometrical ideas without paying attention to the analytical 
difficulties that arise when non-smooth functions arc shown. It must be pointed 
out that the various constructions can be extended in a more or less natural way to 
more involved situations where other analytical or geometrical considerations will 
be needed, for instance in dealing with bounded domains or singular problems. We 
will provide now some background to fix the notation. 

2.1. A geometrical picture of optimal control problems. 

Definition 1 (Control System). A control system is a triple (P, C, F) where: 

i. P is a smooth manifold which is the state space of the control system. Local 

coordinates in P will be denoted by . i = l....n and, generic points by x. 

ii. 77 : C — ^ P is a locally trivial bundle over P which models the controls, i. e. 
the fiber Cx = 7r~^(x) C C over the state x G P, is the space of controls 
acting on the system at the state x, which is assum,ed again to be a smooth 
manifold. Adapted local coordinates on the control bundle will be denoted 
by {x^,u°'), i = 1, . . . ,n, a = 1, . . . ,r, and a generic point by {x,u). 

iii. r is a vector field, on C along the projection map tt which describes the 
dynamics of the control system, i.e., T: C — >■ TP such that Tp o T = ir, 
where tp : TP — )• P denotes the canonical projection map. 

C—^TP 

Y 

P 

Natural local coordinates on the tangent bundle TP will be denoted by 

(a;%w*) or (a:*,i*) if there is not risk of confusion. The local expression 
ofT will be thus T = f^{x,u)d/dx^ and its integral curves x'^{t) will satisfy 
the system of differential equations: 

(1) x\t) = f{x{t),u{t)), i = l,...,n, 

for u{t) belonging to some class of smooth functions u : / C K — >■ C. 

Definition 2 (Optimal Control Problem). An optimal control problem (OCP for 

short) is a quadruple (P, C, F, L) where: 

i. (P, C, r) is a control system. 

ii. L : C ^ M. is a smooth function defined on the control bundle, which 

is the lagrangian density of an objective functional to he m,inimized along 
the integral curves of the control system with fixed endpoints xq = x{Q), 
xt = x{T). The objective functional of the problem will have the form: 

(2) S{a) = [ L{x(t),u{t))dt, 

Jo 
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where a : [0,T] C is a smooth curve on C such that a{t) — {x{t),u(t)), 
x{t) =7rocr(t) andu{t) G TT-'^{x{t)), G [0,r]. 

2.2. The presymplectic picture of geometric optimal control problems. 

It is well known that the basic tool for Optimal Control Theory is the Pontryagin 
Maximum Principle (PMP for short). Here we consider the first order conditions 
in the PMP and we assume that the minimum of ([2]) exists. It is natural to give a 
presymplectic geometrical description of the first order conditions in the PMP. 

Definition 3 (Pontryagin bundle). We call the Pontryagin bundle over P the man- 
ifold M ^ T* P X p C defined as the bundle over the base space P such that the fiber 
over X ^ P is the cartesian product of the corresponding fibers T*P and over 
X e P. 

The manifold M — T* P Xp C is the fiber cartesian product of the two bundles 
T*P and C over P and it has natural local coordinates {x'^,Pi,u°') induced from 
local coordinates {x'^,pi) of the cotangent bundle T*P and (a;*,!*") of the control 
bundle C. We will denote the canonical projection maps from M into the factor 
T*P and C by pp and pc respectively, thus: 

pp:M^T*P, pp{x,p,u) = {x,p) 

and 

pc-M^C, pc{x,p,u) = {x,u). 



M = T*P xpC 




T*P 



P 

The total space manifold M carries a natural presymplectic structure obtained 
by pulling-back to M the canonical symplectic structure ojp in T*P, i.e., 

(3) fl — ppWp — dx^ A dp^. 

Moreover the vector field F and the lagrangian L combine to define a natural 
"energy" function on M , namely the Pontryagin Haniiltonian, 

(4) Hp{x,p, u) = (p, r(a;, u)) - L{x, u) = Pif\x, u) - L{x, u). 

The presymplectic system (M, il. Hp) provides a geometrical model for the PMP 
because the integral curves of (Af, 17, Hp) are extremals for the optimal control 
problem defined by (P, C, P, L). In fact we can notice that the characteristic distri- 
bution K of 17, ker VI = K , \s spanned by vertical vector fields with respect to the 
projection map pp, i.e. 

r d 

K = span < — — ,a — 1, 



Thus if we denote by Xp a vector field defined by the presymplectic system above, 
i.e. 

(5) ix.n^dHp, 

a necessary condition |Go79j for the existence of solutions for the previous implicit 
differential equation in M, i..e. integral curves of a vector field Xp satisfying eq. 
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^, is {Z,dH) = 0, VZ e K, or in local coordinates: 

The conditions ipa = 0, a = 1, . . . ,r, generically define a sub manifold Mi and if 
the presymplectic system eq. ^ has solutions they will satisfy the set of differential 
equations: 

■ i dHp , dHp 

(7) x^-^{x,p,u) p, = - — {x,p,u) 

on Ml. This is equivalent to the first order conditions in the PMP, i.e, the vector 
fields Xp defined by ^ together with the consistency conditions ^ provide the 
extremals for the optimal control problem (P, C, F, L). In the case that the initial 
value problem posed by the differential-algebraic equations ([6|-([7]) at any point 
X € Ml, has a unique solution we will say that the OCP is regular. A necessary 
and sufficient condition for the system {P,C\T, L) to be regular is that Wab = 
d^Hp/du°'du^ has maximal rank everywhere on AIi. We just consider regular 
OCP's in this paper. 

On the other hand, an alternative way to think about the dynamics provided 
by the presymplectic structure O is to consider the complete lifting of the control 
vector field P to M in analogy with what happens for a vector field on a manifold. 
If y is a vector field on a manifold TV, we can consider the complete lifting 
of Y to T*N as the hamiltonian vector field defined by the hamiltonian function 
Py{x,p) — {p,Y{x)). Such vector field satisfies iycwy = dPy and the flow 
of y is just the cotangent lifting of the flow of Y. We can add a potential term 
L(x) to the previous hamiltonian Py to obtain a generalized complete lifting Y 
defined by iyOJN = dH, H{x,p) — {p,Y{x)) — L{x). Notice that the vector field 
Y is projectable with respect to the canonical projection map ttjv : T*N — and 
projects onto Y. This construction can be extended to the case of vector fields along 
maps. Thus, if F : ly — ^ TN is a vector field along the map tt : W — N, we can 
define its complete lifitng to T* N XnW = {{x,p,w) e T* N xW \ p e T* N, Tr{w) = 
x}, as the vector field Y'' on T*N XnW along the map pat : T*N x„ W^T*N 
given by pn{x,p,w) = (w,p) such that iy'jJN = dPy. 

we can consider the vector fields X determined by eq. ([5| as a vector field along 
the projection map pp : M^T*P, i.e., X : M^T{T*P), such that tt-poX = pp. 

2.3. The Lagrange-Pontryagin principle for optimal control problems. We 

provide here a variational picture of an optimal control problem which leads directly 
to the presymplectic picture above. Consider the OCP (P, C, P, L) and denote as 
before by M = r*P Xp C its Pontryagin bundle. We can consider this optimal 
control problem as a constrained minimization problem for the functional ^ with 
constraints given by the control equations ([I]), then under appropriate analytical 
conditions the Lagrange multipliers theorem allow us to characterize the extremals 
of such problem as the critical points of the functional § : Cxo xt {^^) ~^ ^ defined 

by 

(8) §(7) = / [L{x{t),uit)) + {p{t), x{t) - T{x{t),u{t)))] dt 



where Cxa.xTi^^) is the space of the smooth curves 7: [0,T] — ^M with fixed end- 
points x{0) = xo, x{T) = XT and ^{t) = {x{t),p{t),u{t)) £ Cxo,xt{M)- 

Although the solutions for an optimal control problem are the minima of the ob- 
jective functional, we emphasize that in this geometrical framework we are looking 
for the extremals of §, assuming that the minimum exists in the class of curves where 
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we are considering. Then if we denote a tangent vector to the space CxQ^XTi-^^) 
the curve 7(f) by ^ e TjCx„,xt{^'I)j and standard calculation renders (see for in- 
stance [De04j ): 

Jo 

for the differential of § in the direction of f at 7, where ft is the presymplectic 
structure on M, eq. and H{x,p,u) is the Pontryagine Hamiltonian, eq. Q. 

The differential of S is a local 1-form on Cx^^xt (-^^) with local density the l-form 
along 7(t) given by ijfl,^ — dHp o 7, which is precisely the geometrical structure 
present in the presymplectic picture. Moreover 7 is an extremal curve for § iff: 

(9) z^(t)r!^(t) = diip(7(i)), te[o,r]. 

Even if in a mechanical framework a variational principle of this form was called 
Hamilton- Pontryagine variational principle |Yo09) . in the sequel we will call it 
Lagrange-Pontryagine Principle for the OCP (P, C, P, L), because it is obtained from 
a Lagrangian density and is defined on the Pontryagine bundle. We will call 
Hamilton-Pontryagine Principle the corresponding hamiltonian formulation, that is 
obtained from eq. ([S]) rearranging the terms in under the integral: 

(10) S(7)=/ Mt),x{t))^Hp[x{t),p{t),u{t)]dt. 

Jo 

2.4. Dirac structures for optimal control problems. Once the presymplectic 
and the variational pictures for optimal control problems have been introduced we 
proceed further and we will describe their geometry by using Dirac structures. We 
recall here the definition of a Dirac structure [CW88 , Co90 . 

Definition 4 (Dirac structure on a vector bundle E). Let E ^ N be a vec- 
tor bundle on a smooth manifold N , a Dirac structure D on E is a maximally 
isotropic sub bundle of the bundle E (B E* under the bilinear form ((•,•)) given by 
(((m, a), (w, /3))) = (/3, u) + {a,v) , u,v ^ E and a,(3 £ E* . 

Definition 5 (Integrability of a Dirac structure). If E = TN N is a tangent 
bundle of a smooth manifold N , then we will say that a Dirac structure D on TN 
(i.e. a maximally isotropic sub bundle D C TN(BT* N ) is integrable if the condition 

{Cx^a2,X'i) + {Cx^az.Xij + {Cx,ai,X2) = 0, 

is satisfied for all [Xi,ai), {X2,a2), (X^^as) £ D where Cx denotes the Lie de- 
rivative along the vector field X on M. This condition is equivalent to say that D 
is involutive with respect to the Courant Bracket |Co90j defined on the set of the 
sections of the bundle TN (BT* N : 

[(X,a),(y,/3)] = i[X,Y],CxP - Cya+^diPiX) ~ aiY))), 

i.e., if it holds 

[{X,a),{Y,P)]£D yiiX,a),{Y,P))eD 

Definition 6 (Dirac structure on a manifold N). An integrable Dirac structure on 
TN is called a Dirac structure on the manifold N 

A distinguished class of Dirac structures are provided by graphs of both presym- 
plectic or Poisson structures on manifolds. Thus we define the Dirac structure Dq 
associated to a given 2-form il on a smooth manifold N as: 

Dn ^ {{v,a) e TNiS)T*N \ a{w) = n{v,w) G TN} 

and the closedness of H. is equivalent to the integrability of Dq. 
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Thus it is natural to consider the Dirac's structure associated with an optimal 
control problem as the Dirac structure defined by its presymplectic picture. 

Definition 7 (Dirac structure picture of an OCP). We will call the Dirac structure 
Dq C TM (B T* M defined by the canonical presymplectic structure on the Pon- 
tryagine bundle M = T* P x p C the Dirac structure of the optimal control problem 

(p,c,r,L). 

Locally Dn is given by Dn{x,p,u) = {(vx,Vp,Vu\Px,Pp,Pu) G r'(^,p,«)M ® 

^(x,p,u)^'^ \Vx = Pp-, Vp = -Px \ Pn = 0}. 

If Z? is a Dirac structure on a manifold N and H is a smooth function on it, the 
dynamics defined by D and H are given by the vector fields X on N satisfying: 
{X,dH) e D. We can conclude therefore with the proposition-definition for the 
Dirac picture for the PMP of an optimal control problem. 

Proposition 1. Let (P, C, T, L) be an optimal control problem. Consider the canon- 
ical Dirac structure on M — T*P Xp C given by Dq where f2 is the canonical 
presymplectic structure on M. If Hp{x,p,u) — {p,T{x,u)) — L{x,u) defines the 
Pontryagin's Hamiltonian, then the dynamics defined by Dq and dH describe the 
extremal curves for the PMP of the optimal control problem: 

{X,dH) e Dn. 

Because we are interested in regular optimal control problems there is a further 
refinement of the description of the OCP in terms of Dirac structures that will be 
very helpful later on. 

M ^ T{T* P) M T* P 




Then we can consider the canonical Dirac structure Dp C T{T*P) ® T*{T*P) 
defined by the canonical symplectic structure top in T*P. We have seen in section 



(2.2) that the equations of the system related to the PMP are described by a vector 
field X along the canonical map pp : M = T*PxpC^T*P, i.e. X : M^T{T*P) 
such that tt-p o X = pp or locally, if {x,p,u) £ M, then X{x,p,u) £ Tx.p{T* P). 
The Pontryagine Hamiltonian H : M — allow us to define dH : M — ^T*M and 
we can take the restriction of dH to the reduced subspace TMi, where ii : Mi — 
is the sub manifold defined by the consistency conditions of the Gotay-Nester al- 
gorithm ([b]) : iy9o = = 0. We stress that ii^, : TMi ^ TM allow us to consider 
in a natural way the restriction of dH to TMi. In this way the implicit Dirac 
formulation of the Optimal Control Problem (P, C, F, L) is given by the equations: 



(X, dH 

or: {x,p,u) G M, then 



) e Dp in Ml 

TMi 



X{x,p,u),dH{x,p,u) <E Dp{x,p), \/{x,p,u) <E Mi. 

TMi J 

Notice that this equations restricted to Mi have the same meaning of the hamil- 
tonian equations in the presymplectic picture when we solve the consistency con- 
ditions ([6]). 
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2.5. Symmetries and Optimal Control Systems. The main purpose of this 
paper is the study of geometrical optimal control systems with symmetries, and 
in particular, their reduction both from the point of view of the reduction of the 
variational problem that define them and the reduction of the corresponding PMP. 
For it we will start by specifying the notion of symmetry of an optimal control 
problem. 

Let (P, C, r, L) be an optimal control problem. Let G be a Lie group acting on 
the bundle C. We will assume that the action of G on C is fibered with respect to 
the fiber bundle structure of C over P. We denote the action of G on G by: 

*:GxG-^G 

and the action of G on P by: 

$ : G X P-S^ P 

Thus we have that tt o — o n, € G where ^g{x) = $(5, x) and ^'^(a;, u) = 
{x, u)), e G, {x, u) £ C or, in other words, the following diagram commute: 

G — -^C 

TT TT 

Y Y 



Definition 8. The optimal control problem (P, G, F, L) will be said to be G-invariant, 
or to have G as a group of symmetries, if the Lie group G has a fibered action 
on the bundle C and moreover it satisfies: 

i. Lo-^g = L, 

ii. T$goF = Fo*g, 

for all g G G. 

First, we must notice that the action $ of the group G on P lifts both to TP 
and T*P by tangent and cotangent lifting respectively. Thus we shall denote by 
g ■ V = T<^g{v) and g ■ p = r$*_i(p), for all v e T^P, p e T*P, g e G the 
corresponding lifted actions. Then the group G will also act on the Pontryagine 
bundle M = T*PxpG as: 

g-{x,p,u) = {gx,gp,gu) = ($g(a;),T$*_i(p), 

Secondly, we observe that the presymplectic picture of the control system is also 
G-invariant and the group G is represented (pre)symplectically on such system. 

Proposition 2. The group G acts (pre)symplecticaUy on {M,fl,H). Moreover, 
there is an equivariant momentum map Jm ■ M ^ q* such that: 

Hm^ = {dJM,0 

where ^ € g and is the vector field on M describing the infinitesim,al action of^. 
Moreover, we have p*pJp = Jm , where Jp: T*P — ^q* is the canonical momemtum 
map corresponding to the action of G on T*P. 

Proof. A simple computation shows that the function Jm{x,p, u) = {p, ^m{x,p, u)) 
defined on M satisfies the equation above, hence it is the (presymplectic) momen- 
tum map of the action. Again it is easy to check that Jm is equivariant, i.e., 
JM{gx,gp,gu) = Ad*g_iJM{x,p,u). 

□ 
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In general we will assume for simplicity in what follows that the orbit space of 
G on P, i.e., P/G is a smooth manifold and that the canonical projection map 
p: P — ^P/G is a submersion. Later on in order to work out compact expressions 
for the expressions describing the reduced optimal control problems, we will even 
assume that the action of G on P is free and proper, i.e., that P is a principal fiber 
bundle over P/G with structural group G. 

Besides it will be convenient for the stated purposes to assume that the control 
bundle C has a particular form that will make easy to work out the expressions and 
equations on the reduced spaces. We will assume thus that C is the pull-back to 
P of an associated space to P, i.e., let [/ be a smooth manifold where the group G 
acts on the left, i.e., there is an action S: G x U — s-C/. Then, assuming the P/G is 
a smooth manifold, consider the bundle over P/G with standard fiber U given by 
U = {PxU)/G = PxgU. We shall denote the pull-back p*C/ of C/ to P or to r*P 
with the same symbol if there is no risk of confusion. Notice that p*U = P x U, 
however we will keep the notation [/ whenever it will be convenient to indicate the 
we are considering a bundle over P. 

3. The reduction of the Lagrange Pontryagin principle for a class 



Assuming that (P, C, F, L) is an OCP with symmetry G, then the Lagrange- 
Pontryagin's functional 



defined on the space C{M) of smooth curves 7(f) = (x{t),p{t),u{t)) on the Pon- 
tryagin's bundle M, is invariant with respect to the induced action of the group G 
on such space of curves, g ■ -f{t) = {g ■ x{t),g ■ p{t),g ■ u{t)): 



If we were dealing with an specific optimal control problem with fixed endpoints 
xo, XT, we will assume that they are fixed points for the action of G, in such a 
way that the group G acts on the space Cxo,xt{^)- Alternatively in the presence 
of symmetries, the optimal control problem with fixed endpoints Xq, Xt can be 
replaced by a slightly generalized version where we consider endpoints belonging 
to the sub manifolds Gxq and Gxt respectively. In both cases the group G acts 
naturally in the corresponding space of curves. In any of the previous circumstances, 
we will have that the Lagrange Pontryagin functional § will descend to the quotient 
space of equivalence classes of curves with respect to the action of the group G, 
C{M)/G and we will call it the reduced Lagrange-Pontryagin functional. If we 
denote such functional by [§]g, then we will like to characterize its extremal curves 
because there is a natural one-to-one correspondence between extremal curves of 
[§]g and equivalence classes of extremal curves of §. The problem we will study 
in the next paragraphs is the computation of the critical points of [§]g by using 
the geometry of the quotient of the Pontryagin bundle M by G. The explicit 
expression of the Euler-Lagrange's equations S[S]g = in terms of geometrical 
objects on M/G will be called the reduced Lagrange-Pontryagin's equations and 
because they will correspond to the reduced expression of the first order differential 
conditions of the PMP, we will also call them the reduced (first order conditions 
of the) Pontryagin Maximum Principle for the optimal control system (P, G, F, L). 
In order to work them out we will need first the description of various quotient 
bundles related to a reduced optimal control problem. This is the task of the next 
section. 



OF OPTIMAL CONTROL PROBLEMS WITH SYMMETRY 




S{g ■ 7) = S(7) 



V7 e C{M). 
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3.1. Description of some canonical reduced bundles. We will need first to 
describe in a convenient form a few bundles that will show up along the description 
of both, the reduction of the Lagrange-Pontryagin variational principle and the 
reduction of the presymplectic Dirac structure D^i. As we said, we will assume in 
what follows that the action of the Lie group G on P is free and proper, hence 
the quotient space P/G is a smooth manifold and the canonical projection map 
pp: P — ^P/G is a submersion, i.e., we are assuming that P is a principal fiber 
bundle over P/G with structure group G. Orbits of G on P will be denoted either 
by G • a; or \x\ = {gx \ g E G}. Thus points z G P/G will be just z — [x], with 
Pp{x) = z. Local coordinates on P/G will be denoted by z", a = 1, . . . , s. 

3.1.1. The adjoint and coadjoint bundles, g andg* of a principal bundle P{G,P/G). 
Given a principal fiber bundle with total space P and structure group the Lie group 
G, wc can construct two canonical associated bundles the adjoint and the coadjoint 
bundle AdP and Ad* P. They are the associated bundles corresponding to the 
adjoint action of G on the Lie algebra g of G and the coadjoint action of G on 
the dual of the Lie algebra g*. The adjoint bundle is the vector bundle over P/G 
with fiber the linear space q and structure group G, this is AdP = P g, where 
P Xg = {P X q)/G and the group G acts on the left on P x g as • (a;, ^) = 
{xg~^ , Adg£^). The adjoint bundle will be also denoted in what follows by g and 
its points will be denoted by (z, C)- In a similar way we will define the coadjoint 
bundle as the associated bundle to the principal bundle P{G,P/G) with respect to 
the coadjoint action of G on the dual of the Lie algebra g*, thus Ad*P = P x^ g*. 
Notice that because the coadjoint action is the dual action of G on g, then the 
bundles Ad*P is the dual bundle to AdP, thus it makes sense to denote it by q* . 

3.1.2. The principal bundles TP and T*P. We will stablish now some notations and 

identities for TP and T*P. Because G acts freely and properly on P, it also acts 
freely and properly over TP. We will denote this action by ^tp'- G x TP — ^TP, 
^Tp{9,x,v^) = {gx,T^g{x)v:,), g G G, X G P, G T^P, or simply by g{x,Vx) = 
(gx.gvx) if there is no risk of confusion. Then pxp- TP — ^TP/G is a principal 
bundle with fiber G. It is worth mention that TP is also a principal fiber bundle 
over T[P/G) with fiber TG. We can see it in two steps. First, we consider the 
tangent map to the projection pp, Tpp: TP T{P/G). It maps {x,Vx) € T^P 
into {z,Vz) where Vz G Tz{P/G) is given by Vz = Tpp{x)vx- 

TP — ^ r(p/G) 

''"P/G 

P ^P/G 

Second, consider the Lie group TG. We can use left translations to identify it with 

G X g by means of the map A: TG — ^G x g, A{g,Vg) = {g,£, = TL~^Vg). The 
natural composition law of TG is given by {g,Vg) ■ {h,Vh) = {gh,Vg ■ Vh) where 
Vg-Vh = d{g{t)h{t))/dt\t=o and Vg = dg{t)/dt\t=o, Vh = dh{t)/dt\t=o respectively 
and the composition law induced on G x g becomes (g, (,).{h, C) = {g.h, Ad^^ + (), 
for all (g,^), {h, e G X g. Moreover there is a natural action of TG on TP given 
as: 

{g,Vg).{x,Va:) = {g.x, -j^g{t)x{t)\t=o) & Tg^P- 

Notice that ^^g{t)x{t)\t=Q = ^g{t)g~^gx{t)\t=o = {Adgi)p{gx) + g^v^ or in other 
words: 

{9,0-{x,Vx) = {g.x,g^Vx + {Adg^)p{g.x)) 
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In a similar way the right action of G on P can be lifted to a right action of G on 
T*P as [x, ax)-g= (xg, T$*(a;)ax), g e G, x e P, e T*P. The action of G on 
T*P is free and proper hence T*P is a principal bundle over T*P/G. Moreover the 
cotangent bundle T*G of G carries a natural Lie group structure. This structure 
can be easily described by using the last characterization of the Lie group structure 
of TG as a semi-direct product. In fact, we can identify T*G with the cartesian 
product G X 0* by using right translations, i.e. A*: T*G — ^G x g*, K{g,ag) = 
{g, R*ag). Hence because G acts naturally on g* by the coadjoint representation, we 
can define the semidirect product with composition law (g, /i) • {h, v) = {gh, + 
u). With this group structure T*G acts on T*P as {x,ax) ■ {g,lj) = {xg,). 

3.1.3. The associated bundle N determined by a subgroup K of the structure group 
H of a principal bundle X. Some features of the description and properties of the 
quotient bundle TP/G are going to appear repeatedly on what follows, thus it is 
worth to spend some lines commenting the general framework to such problem. 
Consider X to be a right principal bundle with structure group H, base space 
X/H and projection map px,H ■ X — ^ X/H. Let K he a. subgroup of H and 
TV = H/K the corresponding homogeneous i/-space. Notice that H acts naturally 
on the left on N by h ■ (h'K) = {hh')K, for aU h'K a coset in N. Then X is also 
a principal bundle with structure group K, base space X/K and projection map 
Px,K ■ X — ^X/K. There is also a natural projection map 7]: X/K — ^X/H given 
by xK h-^ r}{xK) = xH. We observe that the previous map rj defines a bundle over 
X/H with standard fiber N . Moreover this projection map is nothing else but the 
associated bundle to the H principal bundle X by the action of H on N above, 
this is X Xh N = X/K, where X Xh N denotes the quotient space of X x TV with 
respect to the left action of H on it defined by h ■ {x, h'K) = {xhr^ , {hh')K). We 
can denote by 11: X x A'' — X Xh N the map sending each point (x, h'K) into 
the corresponding equivalence class [x, h'K] (the diagrams below illustrate some of 
these maps). 



XxN 
n 

XxhN - 



Px 



PP,H 

Y 

■X/H 



PX,H 



X/H 



PX,K 



Y 

X/K 



X/H 



In fact, it is clear that the canonical map X x N — ^X/K defined by {x,h'K) h^- 
(xh')K descends to a uia\) XxhN — ^X/K, that provides the identification between 
both spaces. In the particular instance that i? is a semidirect product of two groups 
K and N where TV is a normal subgroup of H , then we conclude that the quotient 
space X/K is a bundle with standard fiber the group N and structure group K 
with respect to the action of on TV provided by the semidirect structure, i.e., K 
acts on TV by the restriction to TV of the inner automorphism h h- > hkh~^ . Finally 
if, TV is a vector space with the natural abelian group structure, then the quotient 
space X/K is the associated vector bundle to X — ^ X/H with structure group K 
and fiber TV. 

In the situation we were considering above the principal bundle X was the space 
TP and the structural group H of the principal bundle was TG. The structure 
group TG is a semidirect product of the subgroups G and the abelian group q 
where the action of G on g is given by the adjoint action. Then, using the remarks 
above we conclude that TP/G is the associated bundle over TP/TG = T{P/G) with 
fiber Q with respect to the adjoint action of G on q, TP Xtg Q- To complete the 
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description of this bundle we shall only notice that the associated bundle TP x tg 
is just the pullback of the adjoint bundle tp/q{q). 

3.1.4. The reduced tangent bundle TP/G or Atiyah bundle. The bundle TP/G can 
be identified with the pull-back to T{P/G) of the adjoint bundle g ^ P/G, and 
with some slight abuse of notation will be denoted as T{P/G) ® g. This elements 
will be of the form [x,Vx] = {z,Vz,() with {z,Vz) g T{P/G) and C G fl- 

If we choose a principal connection ^ on P — > P/G, then we have an explicit 
identification of T{P/G) ® § and TP/G. The map given by: 

a : TP/G ^ T{P/G) ® g, a{[x, v,]) = (TpM, Mvx)) 

where Tp^ : T^P — >■ Tq.x{P/G) is the tangent map to the projection map p : P ^ 
P/G. The dual of this map allows also for an explicit identification of T*P/G = 
T*{P/G) © g*. We have shown that TP/G ^ T{P/G) g is a bundle over P/G. 

3.1.5. The reduced cotangent bundle T* P/G or Weinstein space. |We78] 

The space T*P/G has a canonical bundle structure over T*{P/G). The projec- 
tion map : T*P/G T*{P/G) is defined as: np{[x,px]) = [x] = G ■ x. The 
bundle T*P/G T*{P/G) is the pull-back of the coadjoint bundle g to T*{P/G) 
along the projection map ttp/g '■ T*{P/G) — ^P/G. Again with some slight abuse of 
notation we will denote it for T* {P/G)(B9* ■ Elements on T*P/G will be denoted as 
[x,Px] = {z,pz,p.) where {z,pz) G T*{P/G), z'^ , a = 1, . . . ,m are local coordinates 
on P/G, and € g*. 

As we have seen in the previous section both in the geometrical and in the 
variational picture appears the Pontryagin's bundle M. Thus the quotient space 
M/G plays a fundamental role for the reduction procedure in either treatment of 
optimal control problems with symmetries. 

3.1.6. The reduced control bundle C/G. If G is a symmetry group of the opti- 
mal control system (P, C, F, L), then the quotient space G/G fibrates over P/G. 
In fact the bundle tt: G/G — ^ P/G is nothing else but the push-forward of the 
bundle C along the projection map p. Notice that the map tt : C/G P/G 
given by Tr{[x,u]) = [x] is well-defined and 7r^^[a;] = Tr^^{x) because of the maps 
Px ■ Tr~'^ix) -> 7r~i[x], Pxiu) = [x,u] and 7^ : Tr~'^[x] -J> 7r"i(a:), 7^([a;,M]) = {x,u). 
Then, o — id^-i(^x)- Elements on C = C/G will be of the form [x, u] = {z, u) 
with z e P/G. In what follows and in order to make more transparent some 
constructions relative to quotient spaces, we will assume that the control bundle 
TT : C — P is the pull-back to P of the associated bundle to the principal bundle 
p: P — ^P/G with fiber the space U where the group G acts on the left. With 
the notation above such associated bundle will be denoted by U — P/ G and its 
pull-back to P, p* [U] is simply C — P xU. Hence we will consider that the control 
bundle is trivial, however the action of the symmetry group G on both factors is 
such that the quotient bundle is not necessarily so and becomes C/G ^ U as a 
bundle over P/G. 

3.1.7. The reduced Pontryagin bundle M/G = {T*P Xp C)/G. The Pontryagin 
bundle M = T*PxpC is a bundle over P. Moreover if G is a symmetry group 
of the corresponding control system the action of G lifts to M and fibrates over 
P, hence the quotient space M /G is a bundle over P/G, and it can easily be 
identified with the bundle T* {P/G) © g* ® C7 over P/G. Then the elements of 
the reduced Pontryagin bundle will be of the form: [a;,p,u] — {{z,pz), p,u) where 
{z,pz) e T*{P/G), peg* andue U. 
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TP — ^T{P/G) 



'''PIG 

P/G 



3.2. The reduced Lagrange— Pontryagin principle. Now we can write the ex- 
plicit form of Lagrange-Pontryagin principle. The lagrangian L being invariant 
defines a function I: U = C/G — ^M, by l{z,u) = L{x,u), {z,u) S C/ and x £ P 
such that Pp{x) = z. The dynamical vector field T: C = P xU — ^TP, takes the 
form 

r{x, u) = T{z, u) 7(z, u) 

with r{z,u) e T{P/G) and j{x,u) e Q. In fact T^P = T,(P/G) © f|, hence 
T{x,u) e T^P decomposes as an element T{x,v) in Tz{P/G) and another vector 
7(x,u) in g. Notice that if 7(0;, u) = Ax(T(x,u)) where A is a principal connec- 
tion on P, then '-^{gx.gu) = Aga;{T{gx, gu)) = Agxig.^.T{x,u)) = {L*A)x{T{x,u) = 
Adg{Ax{T{x,u)) = Adg-f{x,u), then 7(2, m) = [■j{x,u)], and 7 defines an element 
on the bundle g over P/G. Moreover, if we compute T{gx,gu) = Tpp{r{gx, gu)) = 
Tpp{g*T{x,u)) = T{x,u), thus F induces a map (denoted with the same symbol) 
f : U^T{P/G), f(z,w) e T,{P/G). 

Using the previous observations we can write then the density L(a;,u,p) = 
L{x, u) -h (p, a; — r(a;, u)) of the Lagrange-Pontryagin variational principle as: 

(11) L(a;,M,p) = l{z,u) + {p^,z -f{z,u)) + {fj,,^ - ^{z,u)) 

where x E T^P is decomposed according to the identification T^P = Tz{P/G) ® g, 
and z = Tpp{x) and ^ = Ax{x) with A a principal connection on P. We have also 
used the identification above T*P = T*{P/G) ® q* and Px ^ {Pz,P')- Notice that 
Jp{Px) = P- and Px is the horizontal lifting oipz with respect to the connection A 
again. 

The reduced Lagrange-Pontryagin variational principle is defined on a space of 

curves on M/G, however those curves are directly related to curves on M, thus the 
variations of such curves are not completely independent. Because of the previous 
discussions, we have that M/G = T*PxgC = T*{P/G) ®q*®U with elements of 
the form {z,pz, p,u) and variations Sz,Spz,5p,du. Notice that 6z{0) = = 6z{T), 
because curves x{t) projects down to curves z{t) G P/G, x{0) = Xq, x{T) = Xt, 
and z{0) = p{xo), z{T) = p{xt)- 

Moreover, given a principal connection A on P, we can always write x{t) = 
g{t)x'^(t) where x'^{t) is the unique horizontal curve on P starting at xq and pro- 
jecting onto z{t) = p{x{t)). Thus xo = g{0)xh{0) = g{0)xo, then g{0) = e and 
similarly g{T) = e. If we write x{t) = g{t)x'^{t) + g{t)x^{t) = g(t)g-'^{t)g{t)x^{t) + 
g{t)x^{t) = C{t)p{x{t)) + g{t)x^{t), using the identification T^P ^ T^{P/G) © g, 
provided by a; = (i, C), where x = x^ + x" , p*a;'' = z, x'" = C,p{x) ( G Q we get that 
the curve ^(0 S corresponds to the vertical component of the curve x. Moreover 
at)=m9~Ht), then: 

= Sgg-'^+gSg-'^ = 5gg~^-gg~^6gg~^ = 5gg-^+5gg~^gg~^-C,5gg~^ = J7+[7?,C] 
and the variations of the curve ^{t) will have the form: 

for an arbitrary r/(f) e fl. 
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3.3. The Lagrange Pontryagin's reduced equations. The Euler-Lagrange equa- 
tions defined by the reduced Lagrange-Pontryagin's principle will provide us with 
the differential conditions of PMP for the reduced system. We can compute them 



from the reduced variational principle Sq on M/G defined by the density eq. ( 11 1: 

Sg= [K^^ u) + {p^,z~ f(z, u)) + (/i, S. - jiz, u))]dt 
Jo 

or from the hamiltonian version given by: 

(12) Sg^ [ [{p„i) + {fi,0-hiz,p,,u)]dt 

Jo 

where h: M/G — s-M is the reduced Pontryagin Hamiltonian defined by: 

h{z,p^,u) = {p^,r{z,u)) + {iJ.,^{z,u)) ~ l{z,u). 

A standard analysis parallel to that in jYo09| will provide us the Euler-Lagrange 
equations of the functional eq. (12 1, SSq = 0: 

dh 

dpz' 



(13) 



dz 
dt 



dh 

du 

that will be called the reduced PMP. 



dt 



dt ~ 



dh 
dz 



—ad'^fi, 



dh 
dfi' 



0. 



4. Reduction of the Dirac structure of optimal control problem 

with symmetry 

The Dirac structure Dq defined on the Pontryagin bundle M of an optimal con- 
trol problem is a sub bundle of the bundle TM®T* M over M . It the optimal control 
problem has a symmetry group G, then we can therefore reduce by taking the 
quotient space Dq/G and consider it again as a sub bundle of (TM © T*M)/G. 
That this idea is consistent is the content of the following simple observation: 



Proposition 3. Under the same hypotheses as in section \2.5\ the Dirac structure 
associated to the presymplectic form D,, C TM T* M is G-invariant. 

Proof. We notice that the action of G on M lifts canonically both to TM and T* M. 
Then {X,a) £ D^, implies that (g^,X, g*^^a) G Dn, where gx denotes the action 
of a group element g E G on x £ M. In fact if {X, a) E Dq, then ft{X, Y) = {a, Y), 
Vy e TM and therefore {g*n){X,Y) = g*{a,Y) = (g*-^a,gY). 

On the other hand, {g*i}){X,Y) = i}{g^:X, g.^,Y) and therefore {g■^,X, g*^^a) G 
Dn- ' ' □ 

Definition 9. The sub bundle [Dnh C TM/G ®T*M/G over M/G is called the 
Dirac reduction of Dq . 

A simple calculation using the identification M/G ^ T*{P/G) ® x [/ (as 
bundles over P/G) discussed in 3.1.7 shows that 

(14) TM/G^T{T*PxpU)/G^TT*{P/G)®ig*®U) x{U®V) 
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and 

(15) T*MIG ^ T*{T*P X U)/G ^ T*T*{P/G) ® [q* ®U)x [U* ® V*), 



where we assume as in section 3.1 that P — ^P/G is a principal bundle with fiber 
G and that the bundle of the controls tt : G — P is the pullback to P of a bundle 
associated to pp : P — ^P/G with standard fiber U, i.e., we have an action of G on 
the space U and we consider the bundle on P/ G defined by (P x U)/G = P xqU 
and we denote this bundle by U. We see that C = p*pU is a, bundle over P with 
fiber U and group structure G. With a little abuse of notation we shall denote even 
with U the pull-back of this bundle to T*{P/G), T{P/G), etc. In both equations 



(14) and (15 1, we denote, as usual, by g, §* the associated bundles to g, g* by the 
adjoint and coadjoint actions respectively, and by V and V* the associated bundles 
toV = Q®Q* and V* = 0* ® by the corresponding induced actions respectively 
(notice that we have identified (§*)* = g and {V*)* — V). 
Again another calculation shows that: 

(16) [Dn]G C TT* {P/G) ® T*T*{P/G) ® (q* ®U) x {U ®U* ®V ® V*). 

Notice that [UsiJg = D^/G does not define a Dirac structure on the reduced 
space M/G because is not a sub bundle of T{M/G) ® T*{M/G). In fact TM/G ^ 
T{M/G) ® ^ T{T*P X U/G) ® g and T* M/G ^ T* {M/G) ® g* , then [Dn]G C 
T{M/G) ® T*{M/G) ® g ® g*. We stress that [Do]g -> M/G is a bundle. We caU 
this bundle a fiber Dirac structure. 

As it follows from the expressions above, dealing directly with the reduced Dirac 
structure [I^nlc is quite involved. However, the presymplectic form 17 is the pull- 
back to M with respect to the projection map pp: M — ^T*P of the natural 
symplectic structure wp on the cotangent bundle T*P, il = PpWp. Then the Dirac 
structure Dq will be related to the canonical Dirac structure on T*P associated 
to the symplectic form ujp in a similar way. This simple observation that will help 
enormously on this task. The precise definition of such relation is given by the 
notion of pull-back and push-forward of Dirac structures |Yo09| . 

Definition 10 (Push-forward and pull-back of Dirac structures). Let ip: N — ^N' 

a differentiable map, and let 'Di'c{N) and 'Div{N') be the sets of Dirac structures on 
N and N' respectively. The forward map Tip : 1)Vl{N) — 1)\x{N') can he defined 
for D e S)ir(iV) by: 

FipiD) = {(V'*(w), a)|u e T7V, a e TN'*; (u, V*(a)) e D}, 

and the backward map Btp: 2'ir(iV') — ^Dix{N) can be defined for D' G 'Dix{N') by: 

B^j{D') = {{v,rm\v e TN,/3e TN'*; {^.{v),(3) e D'}. 

Using these mappings we can define a pullback and a push forward of Dirac struc- 
tures along a map ijj as: 

^^D = FtPiD) 
i,*D' = BipiD') 

Now we see immediately that the pullback p*pDp of the canonical Dirac structure 
on T*P, i.e. Dp = D^^ C T{T*P) ® T*{T*P) defined by the canonical symplec- 
tic structure LUp in T*P, with respect to the projection map pp : M — ^T*P is 
Bpp{Dp) = {iX,p*pa) e TM®T*M \ (pp,X,a) € Dp} and i3pp(i:»p) = Dn and 
similarly, the push-forward of the Dirac structure Dq, with respect to the projection 
map Pp is Dp, i.e,. BY>p{Dn) = Dp. 

The main idea is brought from the description of Marsden and Yoshimura |Yo09) 
of implicit lagrangian systems. Therefore we will name this description as the im- 
plicit description of regular optimal control problems in terms of Dirac's structures. 
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Moreover we can consider directly the Dirac structure on the quotient space 
M/K = M, associated to the symplectic structure U., i.e., D^^ C TM ® T*M. 

The appUcation p : M ^ M induces an appUcation Tp : TM TM and Dq_ is 
the backward with respect to Tp of D^. 

In fact, fohowing the notation of |Yo09| we can introduce the backward map, 
given by BTp{D^^) = {(X,p*a) e TM ®T*M\ {p*X,a) e D^^} and we can see 
that BTp{D^) = Dn. 

We shall denote the relation too by Dq_/K D^^ where K = KerTp and we 
shall say that the presymplectic Dirac structure projects on the symplectic 
Dirac structure D^. 

Finally we observe that the Lie -Dirac reduction of the Dirac structure give 
us another fiber Dirac structure [i^fjlc on T{M/G), i.e.: 

iDnh ■■= D^JG c T(M/G) ® T*{M/G) ® g ® g*. 

It is easy to prove that also the forward map of [-Do]g with respect to the 
projection pp : M T* P is the reduced Dirac structure on T*P. 

The application p: M — ^M induces an application pq: M/G — s^M/G. It is 
easy to have that Bpc[D^]c = [-Do]gj or roughly speaking, the Dirac reduction of 
the Dirac structure defined by the symplectic form fl is the pull-back of the Dirac 
reduction of the Dirac structure induced by the symplectic form f2, or, the fiber 
Dirac structure [-Dnjc projects to the fiber Dirac structure [I^qIg- 

4.1. Reduced Dirac equations of an optimal control problem with symme- 
try. Once the reduced structure is defined, we would have to present the associated 
reduced equations: 

(17) {[Xl[dH])e[Dn]G 

where the symbol [x] indicates the reduced system. Determine these equations 
directly is possible but complicated. To render this calculation more easily we 
make the following observation: the presymplectic structure D, on M is given by the 
pull-back with respect to the projection pp : M T* P of the natural symplectic 
structure w on the cotangent bundle T* P: Q, = pp*uj. Then doesn't contains 
information on the control bundle C. In other words if we consider the Dirac 
structure on T* P associated to the natural symplectic form ujp: 

Dp C T{T*P)(BT*{T*P) 

it is easy to prove that the projection of [-D^Ig with respect to the bundle U (BU* , 
projects on the cotangent reduction of the canonical Dirac structure on T*P because 
the factors U and U* don't appear in the definition of il. 

We shall denote this projection by 11: [-Dsi]g — ^ [Dp]g- On the other hand, 
we can collect here the results obtained by Marsden et al regarding the cotangent 
bundle reduction of the Dirac structure Dp. Thus we have: 

[Dp]g CTT*{P/G)®T*T*{P/G)®{g* x {V®V*)), 

and in local form 

[Dp]g {{z,Pz, ^J■]v^,Vp/,^T^,^:p/,^,VfJ^■,a^,ay^) \ 
\{Trz,6z) + {6pz,TTpJ + {a^,£,) + {a.u^,v^) = (z,p^^f,){vz,Vp^,£,,v^){6z,6pz,C,^fJ'), 



y{Sz,6pzX,Sti) e T(z^p^)T*{P/G) X V). 
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4.2. The Dirac reduction and the reduced Pontryagin's Maximum Prin- 
ciple. In the section §3.3| obtained the equations of the reduced PMP for Optimal 
Control systems with symmetry, based on calculating the differential one of the 
reduction of Lagrange-Pontryagin principle. On the other hand in the previous 
sections, we show how a optimal control problem could be described in two differ- 
ent ways across Dirac's structures: as a presymplectic problem or as an implicit 
problem with Dirac structure Dt* p = Dp. We saw also that both Dirac structures 
are related, being the second one a projection of the first one. 

Finally also we saw that in presence of symmetry we can reduce both Dirac 
structures and the corresponding reduced Dirac structures are related again by 
projection. 

Therefore [-Do]g and [fpjc are such that [Dp\g is the projection of [Dq\g with 
respect to V ®V* . The reduced Dirac structure [Dp]g is the Dirac's reduction 
of Dirac structure cotangent in T*P. Then if we denote for Hq the Pontryagin 
Hamiltonian induced in M/G = T* (P/G) ®Q*®U the quotient space of the Pon- 
tryagin bundle, we have that the sub manifold Mi = = 0} projects to the 
sub manifold [Mi]g = = 0} y Mi/G = [Mi]g. Therefore we will define 
Pontryagin's implicit equation as the dynamics defined by the equation: 



(18) [[X]G{z,p,,,fi,u),[dHG] ^ ^ (z,p^,^,u) e [Dp]g(2:,p^;a*), 

V T[j\/i]g / 

{z,p,)eT*{P/G), ^,eg*. 

These equations coincide with the reduced equations of the PMP obtained previ- 
ously. 

Theorem 1. Given a regular optimal control system (L, F, C — >■ P) with symmetry 
group G, the equations of the Reduced Pontryagin Maximum Principle obtained as 
reduction of Lagrange- Pontryagin's variational principle, coincide with the equa- 
tions of Dirac 's reduction of the equations of the description of implicit Dirac of 
the problem of ideal control, equations \18\ 

Proof. The proof of the theorem relies on the description of Dirac's reduction of 
Dirac's structure cotangent Dp obtained in |Yo09| . We will use the above mentioned 
result without proving it again. This way we obtain that the structure [Dp]g for 
every {z,P:,;ijl) G T*{P/G) © g* has the form (Prop. 4 ^YoOOj): 



[Dp]g{z,Pz;p) = {(wz,WpJ?,W/x), (7r2,7rpja^,a„^) S T(„^p^)T* {P /G) x V® 

®T'lz.,p,)T*iP/G)^V* \ v^=iTp^, Vp.+T^z = -Fa{vz,.), £,=ay^, Vf,-\-a^ = ad*^fi}. 

Then if we denote [X]g as the reduced vector field such that for every curve 
{z{t),pz{t);y.{t),u{t)) e T*{P/G)(SiQ* ® il, take the value 

[x]G{z{t),pS)-.i^{t)Mt))^{^{t),pS)Mt)-,'^-^.^^ 

and bearing in mind that [dH]G ~ dHG restrict to T[Mi\g — T{Mi/G) take the 
form: 

dh dh dh 
[dH\G ^ ^ = {z,p^;^i,u;--—,—,—,0} 

T[Mi]g OZ OPz Ofl 
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and finally: 



(19) 



■ . dh „ 
together with — = 0. 

ou 



( dz _ dh 

dt dpz 

Dp, 



_dh 
Dt dz 

Dfi _ 
^~ dil' 



Fa{v 
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5. A SIMPLE EXAMPLE: THE SUBRIEMANNIAN GEODESIC PROBLEM FOR THE 

HeISENBERG GROUP 

This problem is a basic example in subriemannian geometry and has been solved 
in many different ways. We will use it here to illustrate how the variational theory 
discussed above as well as the Dirac reduction procedure translate into this very 
fundamental example. It is worth to point it out that in this case the hypothesis of 
non existence of abnormal extremals and regularity coincides. It is also interesting 
to remark that the reduction procedure provides a very simple and descriptive way 
to solve this problem. 

The geodesic problem for the 3-dimensional real Heisenberg group in subrie- 
mannian geometry is formulated as the optimal control problem of joining two 
points in by using two non commuting vector fields Fi = ^ — ^^'^ 
r2 = ^ + f which satisfy the commutation relations: 

[ri,r2] = r3; [ri,r3] = [r2,r3] = o, 

and minimizing the length of the corresponding curve, i.e.: if we denote hy q = 
{x, y,z), a point in the three dimensional space M.^ , by u(t) = {ui{t),U2{t)) a curve 
in M.^ and Ts = ^ , and we integrate the differential equation: 

(20) q = T{q) = ui it)Ti (q) + U2 {t)T2 (q) , 

we want to minimize the length of the integral curves of the vector field T with 
respect to the subriemannian metric rjo defined on the distribution D spanned by 
Fi and r2 and given by 

^ ' I q{0) = 90 q{T) = qr- 

The Pontryagin Hamiltonian is given by: 

(22) i?p(a,A,w) =ui(A,ri) +M2(A,r2) - \{ul + ul) = 

(23) = ui(Ai + yXs) + U2{\2 - xM) - ]^{u\ + ul) 

with A G (Ai,A2,A3) e M?*. 

The maximization condition provides an explicit expression for the controls: 

{\Ta)=Ua; a = 1,2 

from which we obtain the hamiltonian function on T*M^: 

^p(9, ^) = \ = ((^1 + 2/^3)' + (A2 - XA3)') , 
and the corresponding hamiltonian system is: 



(24) 



x = \i+ yXs 
y = A2 - a;A3 

z = Xiy- X2X + A3(y2 + x'^) 
Ai = (A2 - a;A3)A3 
A2 = -(Ai +yA3)A3 
A3 = 



The previous equations arc solved in various ways in literature, but here we 
will proceed to integrate it by exploiting the fact that the optimal control problem 
above has a natural symmetry. In order to make it explicit we will describe the 
optimal control problem as a problem on the 3 dimensional Heisenberg group. For 
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our purposes is better to realize the 3-dimensional real Heisenberg group as the 
group of 3 X 3 upper triangular matrices of the form: 

I A C 
1 B 
1 

and the composition law of the group is matrix multiplication. Thus, the left action 
L: Gx G — 5-G is given by the left product of matrices. Notice that as a manifold the 
Heisenberg group is diffeomorphic to M^. The Heisenberg group is a nilpotent 
Lie group whose Lie algebra is generated by the matrices: 

73 = 

\ / 

with commutation relations: 

[71,72] = 73; [71,73] = [72,73] = 
A simple computation shows that the exponential map is given by: 






1 a c+% 
g — exp(a7i + 672 + C73) = | 1 b 

1 

Given the element ^ = U171 + U272 on the Lie algebra of H^, we can define the left 
invariant vector field on : 

5 = g(Mi7i + U272) Ui,1t2eM, 

that, with a suitable choice of coordinates: 

x = a] y = b; z^c-\xy, 



can be written as: 



(25) <^ 



y = U2 



■ xu2 — yui 

^ ~ 2 



which is the control equation in the problem (21). 

In this formulation we can identify the state space of the system P = 11^ =M.^, 
the control bundle is the trivial bundle C = x over and the Pontryagin 
bundle M is given by: 

M ^ T*P XpC = T*{n^) Xni X R^) 



The Pontryagin Hamiltonian Hp: M^M is the function ([22)). The group 
acts on the left on P and this action lifts trivially to C. Hence the optimal control 
problem is invariant under H^. In what follows we will indicate the symmetry Lie 
group of this problem either by : 

Hp{g,\g,u) = h{[g,\g,u]), 

where h: M/G — is the Hamiltonian function induced by the invariant Pon- 
tryagin Hamiltonian Hp, [g,\,u] denotes the orbit of the point {g,X,u) G M 
under the action of G, and the reduced Pontryagin's bundle has the structure 

M/G = T*G/GxU = g* xU = R^ xW^. We are using left translations to identify 
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T*G = G X 0*, i.e., {g,Xg) £ T*G ^ {g,X) £ G x q* with A = L*g\g e T*G ^ q\ 
then Pontryagin's Hamiltonian reads: 

Hp{g, Xg,u) ^ {\g, g{g)) - C{g, u) = (A, 5(e)) - l{u) 

where l{u) — C{[g, u\), and the reduced hamiltonian his a, function of (A, u) G g* x [/ 
alone. In fact we get: 

h{\u) = (A, ui7i +U272) ^ = (t'i,7i)AiUi + (t'2,72)A2U2 ^ , 

where A = + A26'2 + and {6'j} is the dual base of {7^}. 
At this point we can use the consistency conditions (|6|: 

dHp dh 



which implies 



and finally, 



dUa OUa 



Ai = Ui 
A2 = U2 



X2 I \2 

(26) /i(A) ^ + ^2 



2 

The reduced Dirac structure will be the reduction of the canonical Dirac structure 
on G, associated to the natural symplectic form on r*G = g x G. Here we can 
follow the procedure introduced in |Yo07a| and described again in Thm. [1] In the 
particular instance that P is a Lie group G, we have 

Dg = {(a, X) e T*{T*G) ® T{T*G) \ a = wg(., X)} C T*{T*G) ® T(T*G)}, 

and the reduced Dirac structure is a sub bundle: 

[Dg]g C {T*{T*G) e T{T*G))/G ~ g* x (F ® V*) 

where V = Q* ■ Because of the invariance of the Dirac structure, we have for 
each fixed A e g* a Dirac structure [-DgIg ('^) <^ ^ ® ^* 

[Dg]g (A) = {m P). V)) € V®V* I (z., + r;> = c.f ((^, p), (C, a)) V(C, a) € F}, 
where is the A-dependent bihnear form on V given by 

((C, p), (C, a)) = (a, - (p, + (A, C]) • 

Now we apply our main theorem, Thm. [T] that extends to optimal control problems 
the reduction of implicit hamiltonian systems |Yo07a) . In this case because the con- 
straints manifold il/i determined by the optimal feedback is canonically identified 
with T*G, the reduction is that of the standard hamiltonian system {H,T*G, X) 
and it is given by a triple {h, g, x^'^) that satisfies for each fixed A G g*, the reduced 
PMP eq. ([18|: 

(27) {[X]GiX),dhiX))e[DG]GiX) 
where [X]g is the reduced vector field: 

[X]g - 9* -^9 X (g X g*) 

and in local coordinates: 

[X]g= (A,e(A),A), 

where ^(A) = TgLg-^g. 

For the reduced hamiltonian we obtain easily that: 
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and finally, recalling the expression of (26), we obtain the reduced Lie-Poisson 



equations (27 1 



I.e. 



A 

6 = 
6 = 
6 = 
Ai 

A2 
A3 



dh 
dX 



Ai 

A2 



= — A3^2 

= 



The first three equations of this system can be interpreted as a partial Legendre 
transform |Yo07a| . Then we have to solve the reduced Poisson system on g*: 




whose solution is given by: 




Ai.o cos(fct) — A2^o sin(fci) 
Ai'o sin(fci) + A2,o cos(fct) 
k 



If we fix a value for the reduced hamiltonian: 

A? + Al _ 



MA) = 

we obtain a condition for Ai^o and A2,o: 

Ai,o + A2,o = 1- 

Then we can choose: 

Ai,o = COS0 
A2,o = sin 6* 

and the explicit expression for the solutions are: 

Xi{t) = cos{0 + kt) 
X^lt) =siii{e + kt) 
A3(i) = k 

To solve the geodesic problem it is sufficient to reconstruct the dynamic for g(t) 
on G. Remembering that Lg-i^,g{t) = ^(t) we have: 



dg{t) 

dt 

5(0) 



go 



or in components: 
(28) 



i(i) = Ai(<) 

m - A2 

z{t) = XX2 - yXi 



If we consider, for instance the geodesies starting from the origin in M'^, we have 
the initial conditions: 

x(0) = 
y(0) = 

z(0) = 
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and integrating the system p8| ) we obtain the exphcit expression of the geodesies 
in M^: 

x{t) = I sm{kt + 0) - I sin 61 
y(0) = I cos{kt + 9) + I cose 
z{t) = ^ sin(H) + I 

which describe, as it is well-known, spirals in M'^ whose projection on the plane are 
circles of radius ^ and center (— ^^^^^^). 
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